Text prediction

ABSTRACT

One or more techniques and/or systems are provided for suggesting a word and/or phrase to a user based at least upon a prefix of one or more characters that the user has inputted. Words in a database are respectively assigned a unique identifier. Generally, the unique identifiers are assigned sequentially and contiguously, beginning with a first word alphabetically and ending with a last word alphabetically. When a user inputted prefix is received, a range of unique identifiers corresponding to words respectively having a prefix that matches the user inputted prefix are identified. Typically, the range of unique identifiers corresponds to substantially all of the words that begin with the given prefix and does not correspond to words that do not begin with the given prefix. The unique identifiers may then be compared to a probability database to identify which words have a higher probability of being selected by the user.

BACKGROUND

Auto-complete or text prediction techniques are used to predict a wordor phrase that a user is inputting based upon one or more charactersthat the user has already inputted. Today, such techniques are used by awide array of applications to increase the speed and efficiency, oraccuracy, with which users input data. For example, such auto-completetechniques are commonly used in conjunction with SMS applications (e.g.,text messaging applications) and/or email applications on mobile devicesbecause the user input aspect of mobiles devices (e.g., the qwertykeyboards, the touchscreens, etc.) are generally small and hamper auser's ability to quickly input text. Moreover, in other applications,such as in search applications, auto-complete techniques are used toassist the user in quickly generating a string of one or more searchterms and/or promoting the correct spelling of words. In this way, thesearch results may better reflect the intent of the user, for example.Still, in other applications, other benefits may be derived from the useof auto-complete or text prediction techniques.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key factors oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

Among other things, one or more systems and/or techniques for looking upand/or identifying words based upon a given text string of one or morecharacters are provided. For example, in one embodiment, a text string,also referred to herein as a character set, of one or more charactersthat are inputted by a user are received. Based upon this input, one ormore words in a lexicon (e.g., a database of words) having a prefix thatmatches the first character set are identified.

Respective words in the lexicon are respectively associated with aunique identifier (e.g., a number). Generally, the words are arrangedalphabetically and respective words are assigned a unique identifiersequentially and contiguously. Thus, for example, the word “parent” maybe assigned the number 1,000,000 and the word “parents” may be assignedthe number 1,000,001 because the word “parents” follows the word“parent” alphabetically, for example. It will be appreciated thatbecause the respective words are uniquely identified sequentially, givena text string (e.g., a word prefix), a range of unique identifiers thatare associated with words having the given word prefix may beidentified. For example, if the prefix “par” were inputted by a user,unique identifiers 1,000,000 through 1,000,050 may be identified if thewords associated with the unique identifiers of 1,000,000 to 1,000,050begin with the prefix “par.”

Once a range of one or more unique identifiers of words having a prefixthat corresponds to (e.g., matches) the inputted text string has beenidentified, the range can be compared to a probability database todetermine which word(s) within the range is more likely to be the wordthe user is intending to input (relative to the other words associatedwith unique identifiers within the range), and the more likely word(s)can be presented to the user for incorporation into the field that theuser is inputting characters into, for example. In this way, textpredictions can be made given a word sequence without having to indexletter-based representations of the word (e.g., which can be timeconsuming and/or computationally intensive), for example.

In another embodiment, as will be described below, the text predictioncan be further improved by predicting a word and/or phrase based upon achain of one or more previously inputted/selected words and one or moreinputted characters that comprise the word the user is presentlyinputting. For example, given the phrase “the ca,” a prediction may bemade that the word beginning with the letter “ca” is a noun (e.g.,because nouns typically follow the phrase “the”), and thus words thatbegin with “ca” but are not nouns may be excluded from the prediction(e.g., and may not appear as potential words to the user).

To the accomplishment of the foregoing and related ends, the followingdescription and annexed drawings set forth certain illustrative aspectsand implementations. These are indicative of but a few of the variousways in which one or more aspects may be employed. Other aspects,advantages, and novel features of the disclosure will become apparentfrom the following detailed description when considered in conjunctionwith the annexed drawings.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is an exemplary method for identifying a range of one or moreunique identifiers respectively corresponding to words having prefixesthat match a first character set comprising one or more characters.

FIG. 2 is an exemplary lexicon comprising a table, where respectivewords in the lexicon are associated with a unique identifier.

FIG. 3 is an exemplary probability lookup table, where respective uniqueidentifiers are associated with a probability, where the probability isindicative of the likelihood that a respective word associated with arespective unique identifier is a word the user is intending to input.

FIG. 4 is an exemplary method for identifying a phrase based upon two ormore unique identifiers.

FIG. 5 is an exemplary probability chart, where a first column comprisesunique identifiers for a first word, a second column comprises uniqueidentifiers for a second word that proceeds the first word, and a thirdcolumn comprises a probability that a phrase comprised of the first andthe second word is a phrase the user is intending to input.

FIG. 6 is an exemplary system for identifying a range of one or moreunique identifiers respectively corresponding to words having prefixesthat match a first character set comprising one or more characters.

FIG. 7 is an illustration of an exemplary computer-readable mediumwherein processor-executable instructions configured to embody one ormore of the provisions set forth herein may be comprised.

FIG. 8 illustrates an exemplary computing environment wherein one ormore of the provisions set forth herein may be implemented.

DETAILED DESCRIPTION

The claimed subject matter is now described with reference to thedrawings, wherein like reference numerals are generally used to refer tolike elements throughout. In the following description, for purposes ofexplanation, numerous specific details are set forth in order to providea thorough understanding of the claimed subject matter. It may beevident, however, that the claimed subject matter may be practicedwithout these specific details. In other instances, structures anddevices are illustrated in block diagram form in order to facilitatedescribing the claimed subject matter.

Autocomplete features, such as those commonly found in text messagingapplications, search engine applications, etc. predict a word and/orphrase a user is inputting based upon a set of one or more charactersthat the user has previously inputted. The more characters that the userinputs, the narrower the field of possible words/phrases, and generally,the better the prediction can be.

Presently, predictions are made by computing the respective probabilityof respective words/phrases that have a prefix that matches thecharacter/characters inputted/selected by the user. For example, supposea user were to merely entered the character “c,” respective words thatbegin with the letter “c” would be identified in a prefix tree (e.g.,with a root node being with the letter “c”) and a probability forrespective words within the root node “c” would be computed. The 5 or sowords that are more probable would then be identified and presented tothe user as the possible words, for example.

It will be appreciated that the conventional prediction techniques areslow and computationally intensive. For example, there may be tens ofthousands of words that begin with the letter “c.” Thus, tens ofthousands of operations or computations may have to be performed toidentify respective words and their respective probabilities. Suchoperations, even if individually performed rapidly, may consume asubstantial amount of time and/or resources when viewed in theaggregate.

As described herein, systems and/or techniques for predicting wordsbased upon user input are provided herein. Respective words in a lexicon(e.g., a dictionary of words) are assigned a unique identifier. Forexample, respective words may be assigned a number. The uniqueidentifiers are generally assigned such that words sharing a prefix(e.g., “par”) have contiguous identifiers. N-grams may be encoded usingthese word identifiers, for example. In this way, given a prefix, aresulting n-gram can be quickly indexed without indexing letter basedrepresentations. That is, stated differently, based upon a user inputtedcharacter set of one or more characters, which define a prefix, a rangeof unique identifiers corresponding to words comprising the definedprefix may be identified. A database comprising respective uniqueidentifiers and the probabilities of respective words corresponding torespective unique identifiers may be reviewed to determine which word(s)has a higher probability of being input by a user. One or more wordshaving a higher probability (e.g., relative to the words associated withthe remaining unique identifiers within the identified range) may bethen presented to the user for incorporation into a field that isreceiving user input, for example.

FIG. 1 illustrates one example method 100. The example method 100 beginsat 102, and a first set of one or more characters is received at 104.For example, in one embodiment, a user inputs (e.g., by selecting,typing, etc.) one or more characters into a search query field and/orinto a field for generating an email message or a text message. It willbe appreciated that such characters provide a basis, or reference point,from which to identify words and/or make predictions about theword/phrase the user is inputting.

The example method 100 also comprises identifying one or more wordshaving a prefix that matches the first character set at 106. That is, alexicon (e.g., a database) comprising one or more words is searched toidentify a set of one or more words that correspond to (e.g., have aprefix that matches) the first character set that was received at 104.For example, if a user were to input the characters “pa,” wordsbeginning with the prefix “pa” would be identified. It will beappreciated that as described further below, fewer than all of the wordsbeginning with the prefix “pa” may be identified. For example, in oneembodiment, merely the first word alphabetically that begins with “pa”and the last word alphabetically that begins with “pa” may beidentified. Thus, the identification of one or more words having aprefix that matches the first character set may comprise identifyingfewer than all of the words having a prefix that matches the firstcharacter set (e.g., because as will be discussed later, the uniqueidentifiers for words that fall alphabetically between the first wordalphabetically having a given prefix and the last word alphabeticallyhaving the given prefix can be identified merely based upon the uniqueidentifiers for the first word alphabetically and the last wordalphabetically).

Respective words in the lexicon are associated with a unique identifier,such as a unique number. For example, respective entries in a databasemay comprise one word and one unique identifier. Generally, uniqueidentifiers are assigned to the words sequentially and contiguously,such that the lower the word is in the alphabet, the lower the uniqueidentifier and the higher the word is in the alphabet, the higher theunique identifier or vice versa, for example. Typically, no two words inthe lexicon are associated with a same unique identifier. Thus, in oneexample, if the word “parent” is assigned the unique identifier 750,000,the word “parents” may be assigned the unique identifier 750,001 if theword “parents” immediately follows the word “parent” alphabetically inthe lexicon. It will be appreciated that while the unique identifiersdescribed herein are numbers, other forms of unique identifiers are alsocontemplated.

At 108 in the example method 100, a first range of one or more uniqueidentifiers respectively corresponding to the identified words isidentified. Stated differently, the unique identifiers respectivelyassociated with a word having a prefix that matches the receivedcharacter set are identified. It will be appreciated that because theunique identifiers are assigned to the words sequentially, wordscomprising a given prefix may be within a contiguous range ofidentifiers. For example, words that have the prefix “pa” may be withinthe range of unique identifiers beginning at 750,000 and ending at768,000. Every word within this range begins with “pa” and no wordsoutside this range (e.g., that are comprised in the lexicon) begin with“pa.” That is, by identifying the first word in the alphabet that beginswith the characters “pa” and its respective unique identifier and byidentifying the last word in the alphabet that begins with thecharacters “pa” and its respective unique identifier, a range of one ormore unique identifiers corresponding to the first character set of oneor more characters can be identified (e.g., where the range begins withthe unique identifier corresponding to the first word in the alphabetthat begins with the characters “pa” and ends with the unique identifiercorresponding to the last word in the alphabet that begins with thecharacters “pa”). Thus, as described above, by merely identifying thefirst word and the last word having a given prefix (e.g., a prefix thatmatches the first character set) at 106, a range of unique identifierscorresponding to the words in the lexicon beginning with the givenprefix can be identified. Conversely, substantially all of the wordshaving a prefix that matches the first character set can be identifiedat 106, and a range of unique identifiers can be identified at 108 basedupon the identification of substantially all the words at 106.

In one embodiment, based upon the identified first range, probabilitiesof words respectively associated with a unique identifier within therange can be computed and/or determined, and words that are more likelyto be a word the user is intending to input based upon the receivedfirst character set can be identified. For example, the first range ofone or more unique identifiers can be compared with a databaserespectively comprising predetermined probabilities for respective words(e.g., and thus for respective unique identifiers). Within the givenfirst range, unique identifiers (e.g., and thus words corresponding tothose unique identifiers) associated with a higher probability can bedetermined or identified. In this way, words that are more likely tomatch the word the user is intending to input can be determined orpredicted, for example.

Words associated with, or corresponding to, a unique identifier withinthe identified range that have a probability that exceeds apredetermined probability threshold (e.g., the five words that have thehighest probability, words that have a probability that exceeds 0.85,etc.) may be displayed or presented to the user for selection and/orincorporation into the field in which the user is inputting characters,for example. In this way, a user is presented with one or more wordsthat have a prefix matching the characters the user has already inputand with words that have a higher probability of being selected by theuser (e.g., relative to other words in the lexicon that have the sameprefix), for example.

It will be appreciated that number of possible words, and thus the rangeof the unique identifiers may be reduced if additional characters arereceived (e.g., which increases the size of the first character set).For example, if one or more characters are received that increases thesize of the first character set, the number of possible words, and therange of unique identifiers may be reduced or narrowed. That is,returning to the example above, when the characters “pa” were received,a range of unique identifiers of 750,000 to 768,000 was identified. Ifanother character was subsequently inputted by the user, for example, ifthe user were to enter “pat,” the range of possible words, and thus therange of unique identifier may be narrowed, or reduced to a range ofbetween 760,000 and 760,100, for example. Moreover, probabilities forwords merely corresponding to unique identifiers within the range of760,000 and 760,100 would be determined (e.g., significantly reducingthe number of possible words). It will be appreciated that the secondrange of between 760,000 and 760,100 is comprised within the first rangeof 750,000 to 768,000 because the letters “pa” were not altered. Thus,so long as characters are merely added to a character set, and thepreviously entered character set is not altered, the subsequent ranges(e.g., resulting from the added characters) will be comprised within thefirst range. However, if one or more of the initially entered and/orinitially received characters is altered (e.g., the user backspaces andchanges the “pa” to a “pi”), a new range of unique identifiers that maynot overlap and/or may not be comprised within the first range of uniqueidentifiers may be identified

At 110, the example method 100 ends.

FIG. 2 illustrates an example lexicon 200 that may be comprised in adatabase, for example, and configured to store words 202 and uniqueidentifiers 204 respectively corresponding to a word. It will beappreciated that the example lexicon 200 merely illustrates a smallportion of a lexicon, and the actual lexicon 200 may be much larger thanthe illustrated portion. For example, in one embodiment, nearly everyword in the English language and/or in another language may be stored inthe lexicon 200.

As illustrated, respective words 202 are associated with a uniqueidentifier 204. Generally, no two words in the lexicon 200 areassociated with the same unique identifier, and, in one embodiment, thewords 202 are ordered alphabetically, and are assigned a uniqueidentifier sequentially and contiguously. That is, for example, thewords are stored in a prefix tree and are respectively assignedincreasing integers (e.g., if the unique identifiers are integers). Forexample, as illustrated, the word “the” is assigned the uniqueidentifier 1,250,000 and the word “their” is assigned the uniqueidentifier 1,250,001 because the word “their” immediately follows theword “the” alphabetically in the lexicon. Similarly, the word “them”would be assigned the unique identifier 1,250,002 if the word “them”immediately follows the word “their” alphabetically in the lexicon 200,for example. It will be appreciated that while the unique identifiers204 illustrated herein follow a standard numbering scheme, other typesof unique identifiers are contemplated herein. For example, in otherembodiment, the unique identifiers 204 are Roman numerals. In yetanother embodiment, the unique identifiers 204 are characters other thannumeral characters, for example.

If a user were to input the characters “the” (e.g., and thus a characterset comprising the characters “the” was received), words 202 in thelexicon 200 having a prefix that begin with the letters “the” may beidentified and so too may corresponding unique identifiers. For example,as illustrated herein, the words 202 “the,” “their,” “them,” “there,”and “these” (e.g., among others) and their respective unique identifiers204 1,250,000 through 1,250,004 may be identified. Presuming this is allof the words that have the prefix “the,” a first range of uniqueidentifiers (e.g., 1,250,000-1,250,004) may thus beidentified/determined based upon the received character set. That is,stated differently, given a word prefix, a sub-tree of the prefix treeis defined, where the sub-tree is associated with a set of words andtheir unique identifiers respectively.

It will be appreciated that while reference is made to identifyingrespective words in the lexicon 200 that begin with the given prefix“the,” in another embodiment, merely that first word in the alphabetthat has the prefix “the” and the last word in the alphabet that has theprefix “the,” and their corresponding unique identifiers, may beidentified to determine a range of unique identifiers corresponding towords that have a prefix that matches the inputted character set. Forexample, by merely identifying the first word, “the,” and the last word,“these,” a range of unique identifiers (e.g., 1,250,000-1,250,004)corresponding to words having the given prefix can be identified (e.g.,so long as the unique identifiers are ordered sequentially and arecontiguous).

FIG. 3 illustrates an example lookup table 300 that may be stored in adatabase, for example, and may be used to determine the probability 304of respective words given a range of unique identifiers 302corresponding to words comprising a prefix that matches a receivedcharacter set. Thus, returning to the example given with respect to FIG.2, assume the character set “the” has been received and a range ofunique identifiers 1,250,000-1,250,004 has been identified. The rangemay then be compared to a lookup table 300 (e.g., comprising respectiveunique identifiers 302 corresponding to the words 202 in the lexicon 200in FIG. 2 and respective probabilities 304). Words corresponding tounique identifiers 302 with a higher probability (e.g., within thespecified range of unique identifiers) may be determined. For example,with the range of 1,250,000-1,250,004, the unique identifier 1,250,003has the highest probability (e.g., 0.82) and the unique identifier1,250,000 has the second highest probability (e.g., 0.80).

In one embodiment, one or more words corresponding to the uniqueidentifiers with a higher probability within a specified range of uniqueidentifiers (e.g., within a range corresponding to the receivedcharacter set) may be identified and presented to a user as possiblewords that user is attempting to input. It will be appreciated that thenumber of words that are identified and/or presented to the user mayvary depending upon, among other things, the screen size upon which thewords will be displayed, a predetermined probability threshold, etc. Forexample, in the illustrated example, if the two words having the highestprobability within the given range were displayed, the words “there” and“the” would be presented to the user because their corresponding uniqueidentifiers 302, 1,250,003 and 1,250,000, respectively, have the twohighest probabilities (e.g., 0.82 and 0.8, respectively) within thespecified range of 1,250,000 to 1,250,004 in the lookup table 300, forexample.

It will be appreciated that additional information, besides the prefixof a word, can be taken into consideration when determining theprobability of a word (e.g., when determining which words to display toa user). For example, FIG. 4 illustrates an example method 400 forpredicting a word based upon a prefix of the word and an immediatelypreceding word. The example method 400 begins at 402, and a first word(e.g., followed by a character indicating a space) is received at 404.Stated differently, a first set one or more characters is received at404, where the last character of the first set of characters may bespace (e.g., to delineate the set of characters as a word as opposed tomerely a prefix).

At 406 in the example method a unique identifier corresponding to thereceived first word is identified. For example, returning to FIG. 2, ifthe first word was “the,” the unique identifier 1,250,000 may beidentified. It will be appreciated that in one embodiment, the word(e.g. “the”) is merely treated as a prefix and thus a plurality of words(e.g., and/or unique identifiers corresponding to respective words) thathave the prefix “the” may be identified (e.g., the unique identifiers1,250,000-1,250,004 may be identified). In such an embodiment, becausethe first set of characters comprises a space, the lowest uniqueidentifier, for example, may be identified as corresponding to the firstword because the lowest unique identifier corresponds to the first wordin the alphabet having the received prefix. Thus, even if the range ofunique identifiers 1,250,000-1,250,004 were initially identified, in oneembodiment, the first word is identified as being associated with theunique identifier 1,250,000 at 406 because that unique identifier isassociated with the first word in the alphabet having the prefix “the.”

At 408 in the example method 400, a character set of one or morecharacters proceeding the first word (e.g., following the characterdesignating the space) is received. For example, if the user were toinput the characters “the ca,” the characters “the” would be broken offas a first set of one or more characters (e.g., as a first word) and the“ca” would be considered a second character set of one or morecharacters proceeding the word “the.” Thus, a string characters may bebroken into two or more character sets if the string comprises acharacter indicative of a space, for example.

At 410 in the example method 400, one or more words having a prefix thatmatches the second character set is identified. That is, in the examplewhere the character set comprises the characters “ca,” one or more wordshaving the prefix “ca” may be identified in a lexicon (e.g. 200 in FIG.2) in a manner similar to that described with respect to FIG. 2, forexample. It will be appreciated that, as described above, fewer than allof the words in the lexicon having the prefix “ca” may be identified.For example, in one embodiment, merely the first word alphabeticallythat begins with the characters “ca” and the last word alphabeticallythat beings with the characters “ca” may be identified. Thus, whilereference is made to identifying words having a prefix that matches thesecond character set, it will be appreciated that such identification isnot intended to be limited to identifying all the words that have aprefix that matches that second character set. In some embodiments,fewer than all of the words having the given prefix may be identified(e.g., merely first and last words alphabetically).

At 412 in the example method 400, a range of one or more uniqueidentifiers corresponding to words having a prefix that matches thesecond character set are identified as described with respect to FIG. 2.Thus, in the given example, unique identifiers for words having a prefixthat corresponds to “ca” are identified. As described above, such arange may be identified based upon the unique identifier correspondingto the first word in the alphabet that begins with “ca” and the lastwords in the alphabet that begins with “ca.” That is, for example,unique identifiers ranging from 300,000 to 315,000 may be identified(e.g., where the unique identifiers in the range of 300,000 to 315,000respectively correspond to a word that begins with “ca”). It will beappreciated that generally no words outside of the identified range ofunique identifiers begin with “ca” and no words within the range beginwith characters other than “ca.”

At 414 in the example method 400, one or more phrases comprising two ormore words are identified using the unique identifier corresponding tothe first word and the range of one or more unique identifiersrespectively corresponding to words having a prefix that matches thesecond character set. Stated differently, probabilities for the secondword are determined based upon the unique identifier for the first word(e.g. “the”) and the range of unique identifiers respectivelycorresponding to a word that has the prefix “ca,” to identify a phrase(e.g., such as “the cat,” “the car,” etc.). For example, in oneembodiment, bi-grams are generated using techniques known to thoseskilled in the art to determine which word(s) is more likely to followthe word “the” that begins with the prefix “ca.” It will be appreciatedthat the use of a word preceding a prefix to assist in determining whichword(s) are more probable given the prefix “ca,” may improve theaccuracy of the prediction (e.g., improving the chances that a word thatis presented to the user is a word the user selects) relative to merelydetermining probabilities based upon the prefix alone, for example.

Moreover, it will be appreciated that while reference is made to merelyidentifying a phrase based upon a single word and a subsequent prefix,in another embodiment, a phrase may be identified based upon two or morepreceding words and a subsequent prefix. In such an embodiment, a uniqueidentifier for respective preceding words may be identified along withthe range of unique identifiers corresponding to words having a prefixthat matches the subsequent prefix, and these may be used in conjunctionwith one another to identify phrases that more likely correspond with(e.g., match) a phrase the user is inputting, for example.

The example method 400 ends at 416.

FIG. 5 illustrates an example database 500 for determining probabilitiesof words given a preceding word and a prefix of the words such as may beused to identify probabilities for words/phrases, such as at 414 in theexample method 400 of FIG. 4, for example. Specifically, FIG. 5illustrates a drop down menu, for example, where a first column 502comprises unique identifiers for the first word (e.g., the precedingword) of the phrase, a second column 504 comprises unique identifiersfor a second word of the phrase, and a third column 506 providesrespective probabilities of the phrases.

Returning to the example described with respect to FIG. 4, suppose theuser has input the characters “the ca.” As described above, the word“the” may be associated with the unique identifier 1,250,000. Thus, asillustrated, the unique identifier for “the” in the first column (e.g.,1,250,000) is expanded to reveal unique identifiers corresponding towords that proceed the word “the.” It will be appreciated that merely aconsolidated list of the unique identifiers of words that commonlyproceed the term “the” is illustrated in FIG. 5, and the actual list ofunique identifiers may be greater than illustrated herein (e.g., thenumber of unique identifiers between 1,250,000 and 1,250,001 may besubstantially greater than what is actually illustrated).

Further, as described above, the prefix “ca” may be associated withwords corresponding to unique identifiers in the range 508 of 300,000 to315,000. Thus words (e.g., and unique identifiers) outside theidentified range may be excluded from being considered. For example, inthe second column, the unique identifiers 299,999 and 316,186 may beexcluded from the group of possible words and/or phrases because thoseunique identifiers do not fall within the identified range of 300,000 to315,000.

It will be appreciated that some words that begin with the prefix “ca”may not typically follow “the,” and thus would have a probability ofsubstantially zero. For example, while many nouns can follow the word“the,” few, if any, verbs follow such a word. Thus, verbs that beginwith the prefix “ca” and have unique identifiers within the range of300,000 to 315,000 would have a probability of substantially zero whenfollowing the word “the.” It will be appreciated that to reduce theamount of data, for example, unique identifiers that correspond withwords that typically do not follow the word “the”(e.g., having aprobability of substantially zero) may be excluded from the secondcolumn 504 (e.g., because the second column merely illustrates uniqueidentifiers corresponding to words that may follow the word “the” in aphrase).

Within the range 508, the probabilities listed in the third column 506of respective phrases are compared to identify which phrase(s) have ahigher probability of being the phrase that the user is intending toinput (e.g., or which word has a higher probability of following theword “the”). For example, in the illustrated example, the phrasecomprising words corresponding to unique identifiers 1,250,000 (e.g.,“the”) and 311,983 (e.g., “car,” for example) would be a more probablephrase. Thus, the phrase “the car,” and possibly one or more otherphrases (e.g., “the cat”) having a higher probability (e.g., relative tothe probability of other phrases within the range 508) may be presentedto the user for selection/incorporation into the text the user isinputting, for example.

FIG. 6 illustrates an example system 600 for text prediction. Such asystem may be configured to predict a word and/or a phrase based uponuser input and/or known probabilities of words/phrases (e.g. whichwords/phrases are used more often).

The example system 600 comprises a character receiving component 602configured to receive input and/or a selection of characters from a user604. For example, the user 604 may enter text using a touchscreendevice, keyboard, or other input device, and the entered text or otheruser input may be received by the character receiving component 602. Itwill be appreciated that such text may herein be referred to as areceived character set of one or more characters because the textgenerally comprises at least one character.

The character receiving component 602 is operable coupled to a lookupcomponent 606 and is configured to transmit the received character setof one or more characters to the lookup component 606. The lookupcomponent 606 is configured to receive the character set and to identifya range of one or more unique identifiers respectively corresponding toone or more words that comprise a prefix that matches, or otherwisecorresponds to, the received character set of one or more characters.

As described above, the words are generally ordered alphabetically andunique identifiers are generally assigned to the words sequentiallyand/or contiguously. Thus, for example, the word “parent” may beassigned a first unique identifier (e.g., a first integer) and the word“parents” may be assigned a second unique identifier (e.g., a secondinteger) that immediately proceeds the first unique identifier in asequence. That is, for example, if the word “parent” is assigned theunique identifier 1,250,000, the word “parents” may be assigned theunique identifier 1,250,001 because the integer 1,250,001 immediatelyproceeds the integer 1,250,000. It will be appreciated that generally notwo words in a lexicon are associated with the same unique identifier.That is, a unique identifier is unique to merely one word in thelexicon.

In one embodiment, the lookup component 606 is operably coupled to adatabase 608 comprising a lexicon of one or more words. Respective wordsare associated with a respective unique identifier (e.g., as illustratedin FIG. 2). The lookup component 606 is configured to search thedatabase 608, or more specifically the lexicon, to identify one or morewords and corresponding unique identifiers comprising a prefix thatmatches the received character set of one or more characters (e.g.,which may referred to as a given prefix). For example, in oneembodiment, the lookup component 606 searches for substantially all ofthe words in the lexicon that comprise the given prefix, and based uponthe identification of words, can identify unique identifiers forrespective words having prefixes that match the given prefix. In anotherembodiment, the lookup component 606 merely searches for a first wordalphabetically in the lexicon that begins with the given prefix and alast word alphabetically in the lexicon that begins with the givenprefix. If the unique identifiers are assigned to the words sequentiallyand/or contiguously, it will be appreciated that words that fall betweenthe first word and the last word that begin with the given prefix willhave a unique identifier that falls (e.g., numerically) between a uniqueidentifier corresponding to the first word and a unique identifiercorresponding to the last word. Thus, a range of unique identifierscorresponding to words with the given prefix can be determined by thelookup component 606 by identifying substantially all of the words thathave the given prefix (e.g., and recording their respective uniqueidentifiers) and/or by merely identifying the first and last wordalphabetically that have the given prefix (e.g., and identifying a rangeof unique identifiers beginning with a unique identifier correspondingto the first word alphabetically that has the given prefix and endingwith a unique identifier corresponding to the last word alphabeticallythat has the given prefix).

It will be appreciated that the character receiving component 602 maycontinue to receive additional input from the user 604 after the initialfirst set of one or more characters are transmitted to the lookupcomponent 606, and, in one embodiment, the character receiving componentis configured to transmit the additional input (e.g., or replacementinput) to the lookup component 606. In this way, the lookup component606, for example, can redo and/or update the search to identify a rangethat corresponds to words in light of the replacement and/or additionalcharacters (e.g., in real-time). For example, if the initial characterset merely comprised the characters “pa,” the lookup component 606 mayidentify a range of unique identifiers corresponding to words that beginwith the prefix “pa” (e.g. a range of 1,000,000 to 1,130,000, forexample). If an additional character is subsequently received (e.g., theuser inputted text is modified to “pat”), the range of uniqueidentifiers may be updated (e.g., to a range of 1,080,000 to 1,089,000),for example. It will be appreciated that as long as characters aremerely added to the initial character set (e.g., and the initialcharacter set is not changed), the updated range will generally fallwithin the initial range, but may be a narrow or small portion of theinitial range. However, if one of the characters comprised in theinitial character set is modified and/or deleted, the updated range maybe outside of the initial range, for example.

Once a range of unique identifiers has been identified, the lookupcomponent is configured to search a probability database 610 comprisinga probability table, for example, (e.g., as illustrated in FIG. 3). Theprobability table provides for, among other things, probabilityinformation with respect to word usage. Stated differently, theprobability database provides information on how likely or unlikely itis that a user is inputting a given word (e.g., based upon historicaldata of word usage). In one embodiment, the probability table comprisesa column listing respective unique identifiers and a second columnlisting the probability for respective words associated with respectiveunique identifiers (e.g., and/or possibly other data, such as bi-grams,as illustrated in FIG. 5). The lookup component 606, is thus configuredto search the probability database 610 to determine which uniqueidentifiers (e.g., and thus which words and/or phrases) within theidentified range of unique identifiers have a higher probability (e.g.,relative to the probability of other unique identifiers within theidentified range of unique identifiers).

In the example system 600, the lookup component 606 is furtherconfigured to present the words that have the higher probability to theuser 604 via a display 612, for example. In this way, a group of wordsthat have a higher probability of being the word the user 604 isintending to input may be displayed to the user for selection and/orincorporation into a field in which the user 604 is inputting data.

It will be appreciated that the example system 600 is merely intended toillustrate one example system and is not intended to limit the scope ofthe instant application, including the claims. For example, the database608 comprising the lexicon and the database 610 comprising theprobabilities may be a single database or one or more interrelateddatabases. Moreover, the components may provide additional features fromthose herein described. For example, in one embodiment, the lookupcomponent 606 is further configured to identify one or more phrases(e.g., using the techniques described with respect to FIG. 4) based uponat least two unique identifiers, a first unique identifier associatedwith a prefix of a first word (e.g., “the”) and a second uniqueidentifier, or range of identifiers, associated with a prefix of asecond word (e.g., “ca”), for example. In such an embodiment, one ormore of the databases 608, 610 may comprise probability informationsimilar to that described with respect to FIG. 5.

Moreover, it will be appreciated that the components of the examplesystem 600 herein described may be part of a single device (e.g., suchas a mobile device and/or a personal computer), or may spread out acrossa plurality of devices. For example, in one embodiment, the display 612may be part of a personal computer (e.g., a client device), and thecharacter receiving component 602, lookup component 606, and/ordatabases 608, 610 may be components of a server, where the personalcomputer is operably coupled to the server via a network, for example.In such an embodiment, the characters may be input by the user 604 on aclient device and may be transmitted to the character receivingcomponent 602 via the network. Moreover, after the lookup component 606has identified words that have a higher probability of being the wordthe user 604 is intending to input, the words may be transmitted to theclient device (e.g., and the display 612) via the lookup component 606,for example.

Still another embodiment involves a computer-readable medium comprisingprocessor-executable instructions configured to implement one or more ofthe techniques presented herein. An exemplary computer-readable mediumthat may be devised in these ways is illustrated in FIG. 7, wherein theimplementation 700 comprises a computer-readable medium 716 (e.g., aCD-R, DVD-R, or a platter of a hard disk drive), on which is encodedcomputer-readable data 714. This computer-readable data 714 in turncomprises a set of computer instructions 712 configured to operateaccording to one or more of the principles set forth herein. In one suchembodiment 700, the processor-executable computer instructions 712 maybe configured to perform a method 710, such as the exemplary method 100of FIG. 1, for example. In another such embodiment, theprocessor-executable instructions 712 may be configured to implement asystem, such as at least some of the exemplary system 600 of FIG. 6, forexample. Many such computer-readable media 716 may be devised by thoseof ordinary skill in the art that are configured to operate inaccordance with the techniques presented herein.

Although the subject matter has been described in language specific tostructural features and/or methodological acts, it is to be understoodthat the subject matter defined in the appended claims is notnecessarily limited to the specific features or acts described above.Rather, the specific features and acts described above are disclosed asexample forms of implementing the claims.

As used in this application, the terms “component,” “module,” “system”,“interface”, and the like are generally intended to refer to acomputer-related entity, either hardware, a combination of hardware andsoftware, software, or software in execution. For example, a componentmay be, but is not limited to being, a process running on a processor, aprocessor, an object, an executable, a thread of execution, a program,and/or a computer. By way of illustration, both an application runningon a controller and the controller can be a component. One or morecomponents may reside within a process and/or thread of execution and acomponent may be localized on one computer and/or distributed betweentwo or more computers.

Furthermore, the claimed subject matter may be implemented as a method,apparatus, or article of manufacture using standard programming and/orengineering techniques to produce software, firmware, hardware, or anycombination thereof to control a computer to implement the disclosedsubject matter. The term “article of manufacture” as used herein isintended to encompass a computer program accessible from anycomputer-readable device, carrier, or media. Of course, those skilled inthe art will recognize many modifications may be made to thisconfiguration without departing from the scope or spirit of the claimedsubject matter.

FIG. 8 and the following discussion provide a brief, general descriptionof a suitable computing environment to implement embodiments of one ormore of the provisions set forth herein. The operating environment ofFIG. 8 is only one example of a suitable operating environment and isnot intended to suggest any limitation as to the scope of use orfunctionality of the operating environment. Example computing devicesinclude, but are not limited to, personal computers, server computers,hand-held or laptop devices, mobile devices (such as mobile phones,Personal Digital Assistants (PDAs), media players, and the like),multiprocessor systems, consumer electronics, mini computers, mainframecomputers, distributed computing environments that include any of theabove systems or devices, and the like.

Although not required, embodiments are described in the general contextof “computer readable instructions” being executed by one or morecomputing devices. Computer readable instructions may be distributed viacomputer readable media (discussed below). Computer readableinstructions may be implemented as program modules, such as functions,objects, Application Programming Interfaces (APIs), data structures, andthe like, that perform particular tasks or implement particular abstractdata types. Typically, the functionality of the computer readableinstructions may be combined or distributed as desired in variousenvironments.

FIG. 8 illustrates an example of a system 810 comprising a computingdevice 812 configured to implement one or more embodiments providedherein. In one configuration, computing device 812 includes at least oneprocessing unit 816 and memory 818. Depending on the exact configurationand type of computing device, memory 818 may be volatile (such as RAM,for example), non-volatile (such as ROM, flash memory, etc., forexample) or some combination of the two. This configuration isillustrated in FIG. 8 by dashed line 814.

In other embodiments, device 812 may include additional features and/orfunctionality. For example, device 812 may also include additionalstorage (e.g., removable and/or non-removable) including, but notlimited to, magnetic storage, optical storage, and the like. Suchadditional storage is illustrated in FIG. 8 by storage 820. In oneembodiment, computer readable instructions to implement one or moreembodiments provided herein may be in storage 820. Storage 820 may alsostore other computer readable instructions to implement an operatingsystem, an application program, and the like. Computer readableinstructions may be loaded in memory 818 for execution by processingunit 816, for example.

The term “computer readable media” as used herein includes computerstorage media. Computer storage media includes volatile and nonvolatile,removable and non-removable media implemented in any method ortechnology for storage of information such as computer readableinstructions or other data. Memory 818 and storage 820 are examples ofcomputer storage media. Computer storage media includes, but is notlimited to, RAM, ROM, EEPROM, flash memory or other memory technology,CD-ROM, Digital Versatile Disks (DVDs) or other optical storage,magnetic cassettes, magnetic tape, magnetic disk storage or othermagnetic storage devices, or any other medium which can be used to storethe desired information and which can be accessed by device 812. Anysuch computer storage media may be part of device 812.

Device 812 may also include communication connection(s) 826 that allowsdevice 812 to communicate with other devices. Communicationconnection(s) 826 may include, but is not limited to, a modem, a NetworkInterface Card (NIC), an integrated network interface, a radio frequencytransmitter/receiver, an infrared port, a USB connection, or otherinterfaces for connecting computing device 812 to other computingdevices. Communication connection(s) 826 may include a wired connectionor a wireless connection. Communication connection(s) 826 may transmitand/or receive communication media.

The term “computer readable media” may include communication media.Communication media typically embodies computer readable instructions orother data in a “modulated data signal” such as a carrier wave or othertransport mechanism and includes any information delivery media. Theterm “modulated data signal” may include a signal that has one or moreof its characteristics set or changed in such a manner as to encodeinformation in the signal.

Device 812 may include input device(s) 824 such as keyboard, mouse, pen,voice input device, touch input device, infrared cameras, video inputdevices, and/or any other input device. Output device(s) 822 such as oneor more displays, speakers, printers, and/or any other output device mayalso be included in device 812. Input device(s) 824 and output device(s)822 may be connected to device 812 via a wired connection, wirelessconnection, or any combination thereof. In one embodiment, an inputdevice or an output device from another computing device may be used asinput device(s) 824 or output device(s) 822 for computing device 812.

Components of computing device 812 may be connected by variousinterconnects, such as a bus. Such interconnects may include aPeripheral Component Interconnect (PCI), such as PCI Express, aUniversal Serial Bus (USB), firewire (IEEE 1394), an optical busstructure, and the like. In another embodiment, components of computingdevice 812 may be interconnected by a network. For example, memory 818may be comprised of multiple physical memory units located in differentphysical locations interconnected by a network.

Those skilled in the art will realize that storage devices utilized tostore computer readable instructions may be distributed across anetwork. For example, a computing device 830 accessible via a network828 may store computer readable instructions to implement one or moreembodiments provided herein. Computing device 812 may access computingdevice 830 and download a part or all of the computer readableinstructions for execution. Alternatively, computing device 812 maydownload pieces of the computer readable instructions, as needed, orsome instructions may be executed at computing device 812 and some atcomputing device 830.

Various operations of embodiments are provided herein. In oneembodiment, one or more of the operations described may constitutecomputer readable instructions stored on one or more computer readablemedia, which if executed by a computing device, will cause the computingdevice to perform the operations described. The order in which some orall of the operations are described should not be construed as to implythat these operations are necessarily order dependent. Alternativeordering will be appreciated by one skilled in the art having thebenefit of this description. Further, it will be understood that not alloperations are necessarily present in each embodiment provided herein.

Moreover, the word “exemplary” is used herein to mean serving as anexample, instance, or illustration. Any aspect or design describedherein as “exemplary” is not necessarily to be construed as advantageousover other aspects or designs. Rather, use of the word exemplary isintended to present concepts in a concrete fashion. As used in thisapplication, the term “or” is intended to mean an inclusive “or” ratherthan an exclusive “or”. That is, unless specified otherwise, or clearfrom context, “X employs A or B” is intended to mean any of the naturalinclusive permutations. That is, if X employs A; X employs B; or Xemploys both A and B, then “X employs A or B” is satisfied under any ofthe foregoing instances. In addition, the articles “a” and “an” as usedin this application and the appended claims may generally be construedto mean “one or more” unless specified otherwise or clear from contextto be directed to a singular form. Also, at least one of A and B or thelike generally means A or B or both A and B.

Although the disclosure has been shown and described with respect to oneor more implementations, equivalent alterations and modifications willoccur to others skilled in the art based upon a reading andunderstanding of this specification and the annexed drawings. Thedisclosure includes all such modifications and alterations and islimited only by the scope of the following claims. In particular regardto the various functions performed by the above described components(e.g., elements, resources, etc.), the terms used to describe suchcomponents are intended to correspond, unless otherwise indicated, toany component which performs the specified function of the describedcomponent (e.g., that is functionally equivalent), even though notstructurally equivalent to the disclosed structure which performs thefunction in the herein illustrated exemplary implementations of thedisclosure. In addition, while a particular feature of the disclosuremay have been disclosed with respect to only one of severalimplementations, such feature may be combined with one or more otherfeatures of the other implementations as may be desired and advantageousfor any given or particular application. Furthermore, to the extent thatthe terms “includes”, “having”, “has”, “with”, or variants thereof areused in either the detailed description or the claims, such terms areintended to be inclusive in a manner similar to the term “comprising.”

What is claimed is:
 1. A method, comprising: receiving a first characterset comprising one or more characters; identifying a first uniqueidentifier, comprising more than two numbers, corresponding to a firstword having a first prefix that matches the first character set;identifying a first predefined probability for the first word based uponthe first unique identifier, where the first predefined probability doesnot change in response to a modification to the first character set, thefirst unique identifier associated with the first predefined probabilityin a lookup table stored in a database; identifying a second uniqueidentifier, comprising more than two numbers, corresponding to a secondword having a second prefix that matches the first character set;identifying a second predefined probability for the second word basedupon the second unique identifier, where the second predefinedprobability does not change in response to the modification to the firstcharacter set, the second unique identifier associated with the secondpredefined probability in the lookup table stored in the database; anddisplaying at least one of the first word when the first predefinedprobability is within a desired probability range or the second wordwhen the second predefined probability is within the desired probabilityrange, at least some of the method implemented at least in part via aprocessing unit.
 2. The method of claim 1, the first prefix the same asthe second prefix.
 3. The method of claim 1, the first predefinedprobability related to a likelihood that the first word matches a word auser is intending to input.
 4. The method of claim 1, the first uniqueidentifier comprising an integer.
 5. The method of claim 1, the firstpredefined probability different than the second predefined probability.6. The method of claim 1, the second predefined probability related to alikelihood that the second word matches a word a user is intending toinput.
 7. The method of claim 1, the second unique identifier comprisingan integer.
 8. The method of claim 1, the first unique identifierdifferent than the second unique identifier.
 9. The method of claim 1,the receiving a first character set comprising receiving the firstcharacter set in at least one of an email message or a text message. 10.A system, comprising: one or more processing units; and memorycomprising instructions that when executed by at least one of the one ormore processing units, perform a method comprising: receiving a firstcharacter set comprising one or more characters; identifying a firstunique identifier corresponding to a first word having a first prefixthat matches the first character set; identifying a first predefinedprobability for the first word based upon the first unique identifier,the first unique identifier associated with the first predefinedprobability in a lookup table stored in a database; identifying a secondunique identifier corresponding to a second word having a second prefixthat matches the first character set; identifying a second predefinedprobability for the second word based upon the second unique identifier,the second unique identifier associated with the second predefinedprobability in the lookup table stored in the database; and displayingat least one of the first word when the first predefined probability iswithin a desired probability range or the second word when the secondpredefined probability is within the desired probability range.
 11. Thesystem of claim 10, the first predefined probability different than thesecond predefined probability.
 12. The system of claim 10, the firstunique identifier comprising an integer.
 13. The system of claim 10, thefirst unique identifier different than the second unique identifier. 14.The system of claim 10, the first word associated with the first uniqueidentifier in the database.
 15. The system of claim 10, the firstpredefined probability related to a likelihood that the first wordmatches a word a user is intending to input.
 16. The system of claim 10,the second predefined probability related to a likelihood that thesecond word matches a word a user is intending to input.
 17. The systemof claim 10, the first prefix the same as the second prefix.
 18. Acomputer readable medium, excluding signals, comprising processorexecutable instructions that when executed perform a method comprising:receiving a first character set comprising one or more characters;identifying a first unique identifier, comprising more than two numbers,corresponding to a first word having a first prefix that matches thefirst character set; identifying a first predefined probability for thefirst word based upon the first unique identifier, the first uniqueidentifier associated with the first predefined probability in a lookuptable stored in a database; and displaying the first word when the firstpredefined probability is within a desired probability range.
 19. Thecomputer readable medium of claim 18, the first predefined probabilityrelated to a likelihood that the first word matches a word a user isintending to input.
 20. The computer readable medium of claim 18, thefirst unique identifier comprising an integer.